Image sensing system and control method thereof

ABSTRACT

In an image sensing system where a camera apparatus and a client device are connected for controlling the camera apparatus by the client device, the client device displays and arbitrarily shifts a predetermined size of detection area in an object image sensed by the camera apparatus, enabling to quickly perform camera parameter control, such as focus adjustment or the like, based on image signals of the detection area, with a small amount of transferring data. Moreover, detection areas of a sensed image are synthesized by controlling camera parameters for each of the detection areas so as to optimize camera parameters for all of the areas in the object image.

BACKGROUND OF THE INVENTION

[0001] The present invention relates to an image sensing system andcontrol method thereof and, more particularly, to an image sensingsystem where a camera apparatus and a client device are connected, and amethod of controlling the camera apparatus by the client device.

[0002] The assignee of the present invention has already developed animage sensing system, where a camera apparatus and a computer areconnected via an RS serial cable or the like, for controlling an imagesensing direction or zoom ratio of a camera apparatus by panning (rotateon a vertical axis) or tilting (rotate on a horizontal axis) the cameraapparatus in accordance with a control command sent by a computerterminal. In such system, the computer includes software for operating acamera apparatus so that it is possible for an operator to operate thecamera apparatus from the computer terminal by sending a control commandby using a keyboard or mouse or the like.

[0003] In a case where the camera apparatus, connected to a computerterminal, includes functions for automatic focus (AF) and automaticexposure (AE), a control command related to AF or AE may be performedfrom the computer side.

[0004] In a case of utilizing a so-called electronic overhead projector(OHP) apparatus which senses an object (document or the like) placed ona platen, the focal point of the camera apparatus is adjusted so thatthe document placed on the platen is focused.

[0005] In the conventional image sensing system, however, the focalpoint and exposure are normally adjusted to focus the center of asensing object. Therefore, in order to focus or adjust the exposure foran object which is not in the center of the sensing image, the cameraapparatus must be panned or tilted to place the object of interest inthe center of the sensing image. Such operation is cumbersome since theposition of detection area of the camera apparatus must be adjusted.

[0006] Furthermore, in a case where a three-dimensional object is placedon the platen and sensed by the electronic OHP, the focal point must bemanually adjusted to focus the portion subjected to image sensing.

[0007] Furthermore, there is an image sensing system which improves thequality of the sensed image by obtaining focus data and lightness data.In the image sensing system of this type, conventionally, an image issensed by detecting a portion of signals of the image to controlfocusing.

[0008] However, in the conventional image sensing system, opticalparameters set only for a portion of the image are applied to the entireimage. Therefore, in a case where the image includes portions whosedepth and lightness greatly vary, the sensed image of these portions areout of focus or exposure is not appropriate. Moreover, in a case where awide angle image is sensed, a lens having a large field of view angle isgenerally used. In this case, a similar problem also occurs because theoptical parameters are set based only on a part of the image.

SUMMARY OF THE INVENTION

[0009] The present invention is made in consideration of the abovesituation, and has as its object to provide an image sensing system forcontrolling a camera apparatus by utilizing a client device which isconnected to the camera apparatus. More specifically, the presentinvention provides an image sensing system and control method thereofwhich enables the client device to quickly control camera parameters toperform image sensing of a desired area of an image and enables toquickly indicate the area where camera parameters are controlled.

[0010] According to the present invention, the foregoing object isattained by providing an image sensing system where a camera apparatusand a client device are connected for controlling the camera apparatusby the client device, comprising: image sensing means for sensing anobject and obtaining an image signal thereof; detection area controlmeans for controlling a detection area in the image signal; adjustingmeans for adjusting a camera parameter based on an image signal of thedetection area; storage means for storing a shape and size of thedetection area; display means for superimposing the detection area on animage obtained by the image sensing means after the adjusting meansadjusts the camera parameter, based on the position, shape and size ofthe detection area; and shift instructing means for instructing thedetection area control means to shift the detection area.

[0011] Since data related to the size and shape of detection area isstored in storage means in advance, the only information the shiftinstructing means needs to pass to the detection area control means isthe amount of shift in the detection area. Accordingly, the adjustingmeans can quickly control the camera parameters based on the detectionarea, and display means can quickly indicate the detection area on thedisplayed sensed image.

[0012] It is another object of the present invention to provide an imagesensing system and control method thereof which enables immediatefocusing on a desired portion of an object, even in a case where athree-dimensional object is sensed.

[0013] According to an aspect of the present invention, theaforementioned camera apparatus is an electronic overhead projector(OHP) which senses an object placed on a platen.

[0014] By virtue of the above, an object placed on a platen can beimmediately focused on each of the detection areas.

[0015] It is another object of the present invention to provide an imagesensing system and method thereof which enables sensing an image wherethe camera parameters are optimized for the entire area of the image.

[0016] According to the present invention, the foregoing object isattained by providing an image sensing system where a camera apparatusand a client device are connected for controlling the camera apparatusby the client device, comprising: image sensing means for sensing anobject and obtaining an image signal of the object; detecting means fordetecting an image signal of a detection area in the obtained imagesignal; adjusting means for adjusting a camera parameter based on theimage signal of the detection area; storage means for storing the imagesignal of the detection area sensed by the image sensing means after theadjusting means adjusts the camera parameter; shifting means forshifting the detection area; and image synthesizing means forsynthesizing image signals of a plurality of detection areas stored inthe storage means.

[0017] Accordingly, the present invention enables adjusting the cameraparameters in unit of detection areas of an image which is sensed by theimage sensing means and obtain a synthesized image by using the imagesynthesizing means.

[0018] It is another object of the present invention to provide an imagesensing system and method thereof which controls differences of cameraparameters in the synthesized image, which have been optimized bydetection area units.

[0019] According to an aspect of the present invention, the storagemeans stores only image signals of an effective area in the detectionarea, and the image synthesizing means synthesizes images of a pluralityof the effective areas stored in the storage means.

[0020] Accordingly, even if distances of focal points are extremelydifferent in each of the detection areas, since very small effectiveareas in the detection areas are synthesized, differences of cameraparameters in adjacent effective areas can be controlled.

[0021] It is another object of the present invention to provide an imagesensing system and method thereof which can sense an omnidirectionalimage, and an image whose camera parameters are optimized in all areasof the image.

[0022] According to an aspect of the present invention, theaforementioned image sensing system further comprises direction controlmeans for controlling an image sensing direction of the image sensingmeans, wherein the synthesizing means synthesizes images in unit of theimage sensing direction controlled by the direction control means.

[0023] Accordingly, it is possible to obtain a synthesized image whosecamera parameters are adjusted in each of the detection areas in anomnidirectional image.

[0024] The present invention is particularly advantageous since itenables reducing the amount of data in a command to shift the detectionarea. By virtue of this, camera parameter control in the detection areaand displaying the detection area can be quickly performed.

[0025] Moreover, it is possible to sense an image where cameraparameters are optimized in all areas of the image.

[0026] Other features and advantages of the present invention will beapparent from the following description taken in conjunction with theaccompanying drawings, in which like reference characters designate thesame or similar parts throughout the figures thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The accompanying drawings, which are incorporated in andconstitute a part of the specification, illustrate embodiments of theinvention, and together with the description, serve to explain theprinciples of the invention.

[0028]FIG. 1 is a block diagram showing an image sensing systemaccording to an embodiment of the present invention;

[0029]FIG. 2 is a flowchart showing operation of a camera apparatusaccording to the present embodiment;

[0030]FIG. 3 is a flowchart showing operation of a client according tothe present embodiment;

[0031]FIG. 4 is a flowchart showing operation of a client according tothe present embodiment;

[0032]FIG. 5 is an explanatory view showing the form of message data;

[0033]FIG. 6 is an explanatory view showing the form of shiftinstructing command;

[0034]FIG. 7 is a display screen view of a display unit;

[0035]FIG. 8 is an explanatory view of a memory map for various programsaccording to a present embodiment;

[0036]FIG. 9 is a conceptualized block diagram showing a camera controlsystem in a case where camera apparatuses are connected with computerterminals via network;

[0037]FIG. 10 is a flowchart showing operation processing of a cameracontrol system according to the present embodiment;

[0038]FIG. 11 is a table showing correspondences of a type of cameraapparatus and specification of a camera apparatus;

[0039]FIG. 12 is a perspective view of an electronic overhead projector(OHP) according to a second embodiment of the present invention;

[0040]FIGS. 13A and 13B are an object displayed on a display screen ofthe second embodiment;

[0041]FIG. 14 is a block diagram showing an overall construction of animage sensing system according to a third embodiment of the presentinvention;

[0042]FIGS. 15A and 15B are explanatory views related to generating anentirely focused image by designating a detection area;

[0043]FIG. 16 is a flowchart showing processing of synthesizing anentirely focused image;

[0044]FIGS. 17A and 17B are explanatory view for explaining the basicprinciple of consecutively shifting a detection area according to afourth embodiment of the present invention;

[0045]FIG. 18 is a flowchart showing operation processing of an imagesensing system according to the fourth embodiment;

[0046]FIG. 19 is a block diagram showing an overall construction of animage sensing system according to a fifth embodiment of the presentinvention;

[0047]FIGS. 20A to 20C are explanatory views for explaining the basicprinciple of generating an entire-focused omnidirectional image;

[0048]FIG. 21 is a flowchart showing processing for realizing theprinciple shown in FIGS. 20A to 20C; and

[0049]FIG. 22 is a flowchart showing modified processing of theinitializing processing shown in FIG. 10.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0050] Preferred embodiments of the present invention will be describedin detail in accordance with the accompanying drawings.

FIRST EMBODIMENT

[0051]FIG. 1 is a block diagram showing an image sensing systemaccording to a present embodiment. In FIG. 1, reference numeral 100denotes a camera apparatus, primarily comprising components referred toby numerals 101 to 107 which will be described below. Reference numeral200 denotes a computer terminal (hereinafter referred to as a client)primarily comprising components referred to by numerals 201 to 208.

[0052] First, the construction of the camera apparatus 100 is described.An image input unit 101 includes a lens unit having a lens for adjustinga focal point, a diaphragm which adjusts the amount of light, and a CCDwhich converts an optical image inputted through these components intoelectrical signals.

[0053] An automatic exposure (AE) circuit 102 controls shutter speed,aperture stop, auto gain control (AGC) or the like and adjusts anexposure based on image signals obtained by the CCD. An automatic focus(AF) circuit 103 extracts a high frequency components from the imagesignals obtained by the CCD and performs control such that the lens isdriven to the sharpest focus. In the present embodiment, the pulse valueof a motor, provided for driving the focus lens, is adopted as aparameter for AF control.

[0054] Reference numeral 104 denotes a detection area controller whichcontrols the position of detection area subjected to AE or AF controlwith relative to the image subjected to image sensing. The detectionarea controller 104 can shift the detection area in accordance with acommand sent by the client 200. Note that the detection area variesdepending on the specification of a camera apparatus.

[0055] An image output I/F unit 105 is connected to an image input I/Funit 201 of the client 200. The image output I/F unit 105 outputs to theclient 200, image data on which a predetermined processing e.g.,compression or the like, has been performed. A command I/F unit 106 isconnected to a command I/F unit 202 of the client 200 via cable, e.g.,RS232C or the like. The command I/F unit 106 receives/transmits variouscontrol commands or data related to camera parameters. A CPU 107performs overall control of the entire camera apparatus 100. The CPU 107makes various portions of the camera apparatus 100 execute appropriateprocessing according to a control command sent by the client 200.

[0056] Next, the construction of the client 200 is described. An imageinput I/F unit 201 receives image data transmitted by the cameraapparatus 100 and a command I/F unit 202 outputs a control command tothe camera apparatus 100. A display unit 203 includes a CRT or LCD orthe like for displaying an image sensed by a camera apparatus based onthe received image data.

[0057]FIG. 7 shows an example of a display screen of the display unit203. Referring to FIG. 7, reference numeral 300 denotes a sensed image;and reference numeral 301 denotes a detection frame (detection area)where image signals are detected by the camera apparatus 100 and AFcontrol, AE control or the like are performed. Also displayed on thedisplay screen are camera parameters shown by respective bar indicatorsbased on the camera parameter values received via the command I/F unit202. The camera parameters include: a distance between an objectsubjected to image sensing and the camera apparatus (focus distance)indicated by reference numeral 302, shutter speed 303, aperture stop304, gain 305 and zoom ratio.

[0058] Referring back to FIG. 1, an input unit 204 includes a keyboardor a mouse serving as a pointing device, for inputting a control commandby an operator. For instance, an instruction to shift the detection areais inputted by the input unit 204. A CPU 205 performs overallcontrolling of the client 200. Based on programs stored in the ROM 206,which are read out of the ROM 206 and stored in the RAM 207, the CPUexecutes processing for various operation.

[0059] A ROM 206 stores various programs for executing processing ondata inputted by the input unit 204 or executing processing for the CPU205. FIG. 8 shows, as an example, programs stored in the ROM 206. A RAM207 provides a work area for various programs, as described above, orprovides a temporary storage area for data inputted by the input unit204.

[0060] An external memory 208 is exemplified by a floppy disc drive(FDD), hard disc, CD-ROM or the like, which can store programs for theclient 200 to perform processing. The stored program can be executed bytransferring the program to the RAM 207. Note that in the presentembodiment, the size and shape of detection area of an image signal arestored in a table, in the external memory 208 for performing AF or thelike in accordance with the specification of a camera apparatus. Thetable is shown in FIG. 11.

[0061] Next, operation processing of the image sensing system accordingto the present embodiment is described. FIG. 2 is a flowchart showingthe operation performed by the camera apparatus 100 in a case where acommand for shifting the detection area of an image signal is inputtedby the client 200. Note that the processing shown in the flowchart inFIG. 2 is performed by the CPU 107.

[0062] Referring to FIG. 2, in a case where a command sent by the client200 is interpreted as a detection-area-shift command in step S101, thedetection area controller 104 shifts the detection area in pixel unit onthe sensed image in step S102. In a case where the command is notinterpreted as a detection-area-shift command in step S101, otherprocessing which is not shown in FIG. 2 is executed.

[0063] For the purpose of simplified description, it is assumed in thepresent embodiment that the detection area is rectangular. Furthermore,it is assume that the detection-area-shift command sent by the client200 includes a variance amount (Δx, Δy) with relative to the currentposition of the detection area (Δx: the number of pixels shifted in thehorizontal direction, Δy: the number of pixels shifted in the verticaldirection). Note that the shift command is not limited to this example.Assuming the top left corner of an image is the origin (0, 0),coordinates data with relative to the origin may be received as a shiftcommand.

[0064] In steps S103 and S104, image signals in the shifted detectionarea are extracted, AE control is executed by the AE circuit 102 and AFcontrol is executed by the AF circuit 103.

[0065] In step S105, the CPU 107 refers to camera parameter values suchas an exposure value and distance to an object or the like, respectivelycontrolled by the AE circuit 102 and AF circuit 103. In step S106,message data accompanied by the current position of the detection areaand the values of camera parameters is generated, and in step S107, themessage data is transmitted to the client 200. FIG. 5 shows the form ofthe message data. An identifier (ID) indicating the type of theparameter is added to the message data.

[0066]FIG. 3 is a flowchart showing the operation related to imagereception processing performed by the client 200. In step S201 in FIG.3, when image data is inputted to the camera apparatus 100 through theimage input I/F unit 201, a sensed image is displayed on the displayunit 203 in step S202. The sensed image herein is an image picked up bythe camera apparatus 100 which has performed image sensing based oncamera parameters, e.g., focus, aperture stop or the like.

[0067]FIG. 4 is a flowchart showing operation of a client apparatus in acase where the client 200 operates the camera apparatus 100.

[0068] In step S301 in FIG. 4, initializing is performed when theoperation of the client 200 is started.

[0069] Herein, the subroutine of step S301 in FIG. 4, i.e., initializingprocessing, is shown in the flowchart in FIG. 10. In step S401 in FIG.10, the client 200 transmits a command, inquiring the specification ofthe camera apparatus, to the camera apparatus 100 subjected to operationthrough the command I/F unit 202. Upon receiving data related to thespecification of the camera apparatus from the camera apparatus 100 instep S402, the client 200 obtains in step S403, the size of a detectionarea, corresponding to the type of camera apparatus 100, from the tableshown in FIG. 11 stored in the external memory 208. In a case where itis determined based on the response from the camera apparatus 100 thatthe specification of the camera apparatus 100 is, e.g., type A, thetable shown in FIG. 11 is referred in order to obtain the size of adetection area for type A. Referring to the table in FIG. 11, in a casethe shape of detection area varies depending on the camera apparatus,the shape may be stored in association with the camera specification.

[0070] In step S404, the detection frame 301 corresponding to the sizeof a detection area obtained from the table is superimposed in thecenter portion of the sensed image 300 displayed on the display unit 203as shown in FIG. 7.

[0071] As set forth above, since data related to the size of thedetection area is stored in association with the type of cameraapparatus 100, the client 200 can superimpose an appropriate form of adetection frame on the screen displaying the sensing image withoutobtaining data for the size of a detection area from the cameraapparatus 100 in the initializing processing in step S301 in FIG. 4.Furthermore, in a case of sending a command to shift the detection areaas will be described later, the client 200 does not need to exchangedata related to the size of the detection area with the camera apparatus100, thus making it possible to reduce the amount of data fortransmission/reception.

[0072] In the initializing processing of the client 200 shown in theflowchart in FIG. 10, although the client 200 inquires of thespecification of the camera apparatus to the camera apparatus 100, theclient 200 may directly inquire of the size and shape of detection areaof the camera apparatus without including the table shown in FIG. 11.FIG. 22 shows the modified example of the initializing processing inFIG. 10.

[0073] In step S2201 in FIG. 22, the client 200 inquires for datarelated to the detection area of the camera apparatus 100, subjected tooperation, via the command I/F unit 202. In response to the inquirycommand, the camera apparatus 100 outputs data related to the detectionarea to the client 200 through the command I/F unit 106.

[0074] Herein, data related to the detection area is informationindicative of the size and shape of detection area. For instance, if theshape of detection area of the camera apparatus 100 is rectangular, thedata outputted to the client 200 includes information indicative of thevertical and horizontal lengths of the rectangle in addition toinformation indicating that the detection area is rectangular. If theshape of detection area of the camera apparatus 100 is circular, thedata outputted to the client 200 includes information indicative of theradius in addition to information indicating that the detection area iscircular. If the shape of detection area of the camera apparatus 100 isan equilateral triangle, the data outputted to the client 200 includesinformation indicative of the length of a side of the triangle inaddition to information indicating that the detection area is aequilateral triangle.

[0075] Upon receiving the above-described data related to the detectionarea from the camera apparatus 100 in step S2202, the client 200superimposes the detection frame 301 in the center of the sensed image300 in step S2203 based on the obtained data.

[0076] In a case where the processing shown in FIG. 22 is performed, thetable shown in FIG. 11, storing detection area data for respectivespecifications of camera apparatuses, does not need to be stored in theclient terminal 200. Accordingly, the amount of data stored in theexternal memory 208 can be reduced.

[0077] Referring back to the flowchart in FIG. 4, in step S302, theclient 200 initializes a variable ACK which indicates whether or not aresponse message from the camera apparatus 100 is received. In thepresent embodiment, the initial value of the variable ACK is set to 0.More specifically, if the value of the variable ACK is 0, a responsefrom the camera apparatus has been received, while if the value of thevariable ACK is 1, a response from the camera apparatus has not beenreceived. The value of the variable ACK is written in the RAM 207 sothat the value can be referred to at any time.

[0078] In step S303, determination is made as to whether or not amessage from the camera apparatus 100 is received through the commandI/F unit 202. In a case where a message is received, the receivedmessage is interpreted in step S304 to interpret camera parameters andposition information of the detection area included in the message. Instep S305, the position of the detection frame 301 and positions ofcursors for the display portions 302 to 305 are updated on the displayscreen of the display unit 203 shown in FIG. 7 based on the interpreteddata.

[0079] In step S306, the value of the variable ACK is reset to 0 and theprocessing returns to step S303.

[0080] As described above, since the client 200 obtains cameraparameters from the camera apparatus 100 and displays the obtained data,information related to the currently focused distance and exposure ofthe camera apparatus 100 are clear to an operator.

[0081] Meanwhile, in a case where determination is made in step S303that a message has not been received, the processing proceeds to stepS307 where determination is made as to whether or not the value of thevariable ACK is 0. If the value of the variable ACK is not 0, theprocessing returns to step S303. In a case where the value of thevariable ACK is 0, determination is made in step S308 whether or not acommand for shifting the position of the detection area is inputted byan operator through the input unit 204. If the command is not inputted,the processing returns to step S303.

[0082] In a case where a command is inputted in step S308, theprocessing proceeds to step S309 where the amount of shift with respectto the current position is obtained. In step S310, a command forinstructing the camera apparatus 100 to shift the detection area isgenerated.

[0083] Shown in FIG. 6 is a form of a detection-area-shift command to besent to the camera apparatus 100. As shown in FIG. 6, thedetection-area-shift command only includes data related to the amount ofshift for X and Y directions. Since data related to the size of thedetection area is known to both sides of the camera apparatus 100 andthe client 200, the data for the size of the detection area does notneed to be transmitted; thus, the amount of communication data can bereduced. Note that the detection-area-shift command is generated inresponse to dragging operation or the like inputted in the detectionframe 301 of the displayed image 300 by the input unit 204 e.g., a mouseor the like.

[0084] In step S311, the command generated as described above istransmitted to the camera apparatus 100 through the command I/F unit202. In step S312, the value of the variable ACK is set to 1 and theprocessing returns to step S303.

[0085] Note that although the camera apparatus 100 and client 200 areconnected on a one-to-one basis in the construction of the image sensingsystem shown in FIG. 1, a plurality of camera apparatuses and aplurality of clients may be connected via network as shown in FIG. 9. Inthis case, specifications of the camera apparatuses may vary. In suchcase, the table such as that shown in FIG. 11 is stored in each of theclients 200. In the table in FIG. 11, the size and shape of detectionarea for each specification of a camera apparatus is stored in advance.

[0086] Note that in the present embodiment, the camera parametersoutputted from the camera apparatus to the client may also include azoom ratio of the camera apparatus.

SECOND EMBODIMENT

[0087] Hereinafter, the second embodiment of the present invention willbe described. The second embodiment describes a case where the cameraapparatus 100 in the first embodiment is applied to a so-calledelectronic overhead projector (OHP). An image sensing system accordingto the second embodiment is shown in FIG. 12. Referring to FIG. 12, acomputer terminal 200 (hereinafter referred to as a terminal)corresponds to the client 200.

[0088] In FIG. 12, reference numeral 401 denotes a platen where anoriginal document 402 is placed and the camera apparatus 100 performsimage sensing. Image data of the original document 402 which is sensedby the camera apparatus 100 is outputted to the terminal 200 anddisplayed on a display screen 403 of the display unit 203. The focaldistance is adjusted so that the original document 402 is focused.

[0089] In a case where an object placed on the platen 401 has athree-dimensional shape, the conventional camera is able to focus onlyon a part of the three-dimensional object. Thus, when another part ofthe object is to be focused, an operator must manually adjust focusing,and this was a cumbersome operation to an operator.

[0090] The second embodiment provides an electronic OHP system capableof quickly focusing a portion of an object, subjected to image sensing,in a case where a three-dimensional object is placed on the platen 401.Note that a keyboard 405 and mouse 404 serve as the input unit 204 whichis used when a command is inputted by an operator. Other configurationof the electronic OHP system according to the second embodiment isidentical to that shown in FIG. 1. Thus, description thereof will beomitted.

[0091] The electronic OHP system according to the second embodimentperforms AF control by detecting a part of image signals sensed by thecamera apparatus 100 so that the part of the object to be sensed isfocused. The detection area is shifted by a shift command sent by theterminal 200. Since such operation of the electronic OHP system isidentical to that of the first embodiment, description thereof will beomitted.

[0092]FIGS. 13A and 13B show examples of the display screen 403 at thetime of sensing a three-dimensional object 501. Referring to FIGS. 13Aand 13B, a detection frame 301 indicates the area where image signals ofthe camera apparatus 100 are detected. In a case where the detectionarea is shifted by a command inputted by the input unit 204, thedetection frame 301 is moved accordingly.

[0093]FIG. 13A shows the object 501 displayed on the display screen 403in a case where the detection area is shifted to a portion 502 of theobject 501. AF control is performed on the portion 502. Herein, if theheight of the object measured from the platen 401 is different betweenthe portion 503 and the portion 502, the object portion 503 is out offocus. In such case, the detection area is shifted to the object portion503 by input operation of the input unit 204, e.g., keyboard 405 or thelike, and the object portion 503 is brought to focus. This state isshown in FIG. 13B.

[0094] As described above, by having the computer terminal 200 send acommand to shift the detection area where image signals are detected andexecute AF control on the shifted detection area, it is possible tofocus a portion of interest of the object. By virtue of this feature,for instance, in a case where the electronic OHP according to thepresent embodiment is utilized in a meeting or the like where athree-dimensional object is shown, an efficient presentation can begiven.

[0095] Note that although AF control is executed on the detection areaby shifting the detection area where image signals are detected in thesecond embodiment, this may be set for AE control or white balancecontrol. Moreover, these processing may be simultaneously executed.

[0096] As has been described above, according to the first and secondembodiments, the detection-area-shift command having as small a datasize as possible can be transmitted from the client (computer terminal)200 to the camera apparatus 100. Moreover, an appropriate detectionframe 301 can be displayed on the display screen of the client 200 inaccordance with the size and shape of detection area of various cameraapparatuses.

[0097] Furthermore, an appropriate image of a three-dimensional objectcan be sensed by the electronic OHP apparatus.

THIRD EMBODIMENT

[0098] The third embodiment provides an image sensing system whichbrings each area of an image to focus, thereby obtaining an entirelyfocused image.

[0099]FIG. 14 is a block diagram showing a construction of an imagesensing system according to the third embodiment.

[0100] The image sensing system according to the third embodimentincludes a camera apparatus 1101 and a client device 1105 (hereinafterreferred to as a client).

[0101] The camera apparatus 1101 comprises: an image sensing devicewhich inputs an image, e.g., CCD or the like; an image sensing system1102 which converts signals obtained by the image sensing device intostandardized signals, e.g., NTSC signals or the like; a lens controller1104 which automatically controls the focus and exposure of the cameraapparatus; and the detection area setting unit 1103 which sets thedetection area to which focus and exposure are adjusted. Note that inthe camera apparatus 1101, focus, aperture stop, shutter speed, gain,white balance or the like can be controlled in accordance with a controlcommand externally inputted.

[0102] The detection area setting unit 1103 and lens controller 1104 areconnected with the client 1105 via control signal line. By outputtingcontrol signals to the camera apparatus 1101, the client 1105 can-setthe position and size of the detection area or parameters such as focus,aperture stop or the like. The client 1105 can obtain the currentsetting of parameters from the camera apparatus 1101. Although RS-232Cor parallel I/O may be used as control signal lines, the communicationmethod standard is not specified herein.

[0103] The lens controller 1104 comprises an AF circuit whichautomatically detects a focal point; and an AE circuit whichautomatically adjusts exposure. According to the third embodiment, themethod of AF is controlled such that the high-frequency components areextracted from the image signals obtained by the image sensing system1102 and the lens is driven so that the image is the clearest. Theclient 1105 can select either to control focus and exposure of thecamera apparatus through the client 1105 via control signal lines or tolet the camera apparatus 1101 independently perform AF or AE control.

[0104] In the client 1105, the CPU 1106 controls the entire client 1105.ROM 1108 stores programs for executing processing by the client 1105.RAM 1107 stores programs read out from the ROM 1108. Furthermore, asecondary memory 1109 comprising hard disc or the like stores cameraparameters such as the result of focal point detection obtained by thecamera apparatus 1101. Note that camera parameters may be stored in theRAM 1107.

[0105] An I/O unit 1110 is used to communicate control signals with thecamera apparatus 1101. A communication I/F unit 1112 is used incommunication with apparatuses, capable of processing similar to that ofclient 1105, via network 1117. By this, all camera apparatuses includedin the clients connected to the network 1117 can be controlled by anyclient apparatuses.

[0106] A keyboard 1113 and mouse 1114 respectively serve as an inputunit where an operator inputs a command to operate the camera apparatus1101. A monitor 1115 displays a sensed image based on image signalsoutputted by the camera apparatus 1101.

[0107]FIGS. 15A and 15B are conceptualized views showing basic principleof the third embodiment.

[0108] Hereinafter, a focus is described as an example of parameters setfor the camera apparatus 1101 by the client 1105. FIG. 15A shows anentire image 1201 and a unit of focal point detection area 1202.

[0109] According to the third embodiment, automatic control of focus(AF) is performed by extracting high-frequency components by applying afrequency filter to image signals of the focal point detection area 1202set by the detection area setting unit 1103, and adjusting the positionof a focus lens so as to output the maximum high-frequency signals. Notethat focusing may be realized by other methods.

[0110] Referring to FIGS. 15A and 15B, although the focal pointdetection area 1202 is shown as a rectangle, the shape and size ofdetection area is not limited as long as minimum image signals necessaryfor appropriate AF control are obtained.

[0111]FIG. 15B shows the state where a focal point detection area issequentially shifted in unit of the area set as shown in FIG. 15A, bythe detection area setting unit 1103 based on a command sent by theclient 1105. In this manner, the focus is optimized in unit of eachfocal point detection area and image sensing is performed. Accordingly,it is possible to obtain an image where all the focal point detectionareas are focused.

[0112] As described above, the focal point detection area is set to thesize where AF control can be performed, then the image 1201 is dividedinto a plurality of focal point detection areas 1202 and AF control isperformed sequentially on each of the divided detection areas. Then,focused images are obtained from each of the focal point detection areasand synthesized. As a result, an entirely focused image where the focusof the entire image is optimized can be obtained.

[0113]FIG. 16 is a flowchart of the basic processing according to thethird embodiment.

[0114] Upon starting the image sensing system according to the thirdembodiment, the size of a focal point detection area is determined (stepS1302). In the third embodiment, the focal point detection area is arectangle, and its size can be changed in accordance with a requiredcompression rate of a focused image or processing time.

[0115] Upon determining the size of the detection area, the image 1201is divided accordingly, and the CPU 1106 sends a command to thedetection area setting unit 1103 to sequentially shift the focal pointdetection position (step S1303). The lens controller 1104 then utilizesimage signals in the focal point detection area 1202 to perform AFcontrol, senses only an image of the focused detection area 1202 andstores the sensed image in the RAM 1107 (step S1304). The position ofthe focal point detection area is expressed by Cartesian coordinatesystem or polar coordinate system. For a method of instructing a shiftof the focal point detection area, designation may be made by utilizingthe absolute coordinate system or relative coordinate system. Howeverthe method for expressing such position or designation is not specified.

[0116] Then, it is determined whether or not focused images in all thefocal point detection areas 1202 of the image 1201 are obtained (stepS1305). If focused images are not obtained from the entire image 1201,the processing returns to step S1303 where the processing is moved tothe next detection area.

[0117] As described above, by obtaining a focused image of each area forthe entire image 1201 in unit of the focal point detection area andsynthesizing each of the detection area images, an entirely focusedimage is obtained (step S1306). The synthesized image where the entireimage is focused is outputted to the monitor (step S1307) and theprogram ends (step S1308).

FOURTH EMBODIMENT

[0118] Next, the fourth embodiment of the present invention is describedin detail.

[0119] In the aforementioned third embodiment, the entire image isdivided into a plurality of detection areas and parameters are optimizedfor each of the divided areas. Thus, if a focus distance is extremelydifferent between neighboring areas, image nonconformity may becomeconspicuous in the boundary portion. In the fourth embodiment, the focalpoint detection area is consecutively shifted to the neighboring area,AF control is performed at each shifted position and image sensing isperformed. Then, only a very small area in the central portion of eachdetection area is obtained and synthesized so as to obtain an entirelyfocused image where image nonconformity is minimized. An example thereofwill be described hereinafter.

[0120] The construction of the image sensing system according to thefourth embodiment is identical to that shown in FIG. 14. Therefore,description thereof will be omitted.

[0121] The concept of the fourth embodiment is now explained withreference to FIGS. 17A and 17B.

[0122]FIG. 17A shows the focal point detection area 1402 and a verysmall area used as a unit of area stored for synthesizing an image. Thevery small area will be referred to as an effective area 1403hereinafter. The size of the effective area 1403 can be changed within arange of one pixel being a minimum size and the detection area 1402being the maximum size. The size can be changed in accordance withconditions such as the processing time, processing capacity of an imageprocessing apparatus, or required quality of the synthesized image.

[0123] Herein, a coordinate system is provided, assuming that the bottomleft corner of an image is the origin, the horizontal side is thepositive direction of x axis and the vertical side is the positivedirection of y axis. Assume that the horizontal and vertical lengths ofthe displayed image 1401 are I_(x) and I_(y) respectively, thehorizontal and vertical lengths of the detection area 1402 are W_(x) andW_(y) respectively, the horizontal and vertical lengths of the effectivearea 1403 are S_(x) and S_(y) respectively, and the effective area 1403is located in the center (x, y) of the detection area 1402. In thecoordinate system, assuming that a rectangular area is expressed by acoordinate of the bottom left point and a coordinate of the top rightpoint, a focused image of the effective area 1403 expressed in thefollowing coordinates (1) can be obtained as a part of focused imageobtained by setting the detection area 1402 to the following coordinates(2). $\begin{matrix}{\left( {{x - \frac{S_{x}}{2}},{y - \frac{S_{y}}{2}}} \right),\left( {{x + \frac{S_{x}}{2}},{y + \frac{S_{y}}{2}}} \right)} & (1) \\{\left( {{x - \frac{W_{x}}{2}},{y - \frac{W_{y}}{2}}} \right),\left( {{x + \frac{W_{x}}{2}},{y + \frac{W_{y}}{2}}} \right)} & (2)\end{matrix}$

[0124] Note that (x, y) is the coordinates of the center of thedetection area, and x takes the range of W_(x)/2≦x≦I_(x)−W_(x)/2, and ytakes the range of W_(y)/2≦y≦I_(y)−W_(y)/2.

[0125] In the above coordinates (1) and (2), each component of thecoordinates (x, y) is independently altered by the following, (3) and(4). $\begin{matrix}{{x = \frac{W_{x}}{2}},{\frac{W_{x}}{2} + S_{x}},{\frac{W_{x}}{2} + {2S_{x}}},\ldots \quad,{\frac{W_{x}}{2} + {n\quad S_{x}}},\ldots \quad,{I_{x} - \frac{W_{x}}{2}}} & (3) \\{{y = \frac{W_{y}}{2}},{\frac{W_{y}}{2} + S_{y}},{\frac{W_{y}}{2} + {2S_{y}}},\ldots \quad,{\frac{W_{y}}{2} + {n\quad S_{y}}},\ldots \quad,{I_{y} - \frac{W_{y}}{2}}} & (4)\end{matrix}$

[0126] As a result, a group of focused images of effective areas 1403 inthe ranges of the following equations, (5) and (6), can be obtained.$\begin{matrix}{\frac{W_{x}}{2} \leq x \leq {I_{x} - \frac{W_{x}}{2}}} & (5) \\{\frac{W_{y}}{2} \leq y \leq {I_{y} - \frac{W_{y}}{2}}} & (6)\end{matrix}$

[0127] In the displayed image 1401, with respect to areas whereeffective area 1403 cannot be obtained, i.e., areas in which the valueof x or y is included in the following range (7) or (8), since the areais not closely looked at, the image of the detection area 1402substitutes the image of the effective area 1403. $\begin{matrix}{{0 \leq x \leq \frac{W_{x}}{2}},{{I_{x} - \frac{W_{x}}{2}} \leq x \leq I_{x}}} & (7) \\{{0 \leq y \leq \frac{W_{y}}{2}},{{I_{y} - \frac{W_{y}}{2}} \leq y \leq I_{y}}} & (8)\end{matrix}$

[0128] By synthesizing all the effective areas 1403 obtained in theforegoing manner, it is possible to obtain the displayed image 1401where the entire areas are focused as shown in FIG. 17B.

[0129] The flowchart of the image sensing system according to the fourthembodiment is shown in FIG. 18.

[0130] Upon starting the system (step S1501), the size of the focalpoint detection area 1402 is set (step S1502) and the size of theeffective area 1403 is set (step S1503) according to a command sent bythe client 1105. The effective area 1403 is included in the detectionarea 1402 as described above. Then, the focal point detection area 1402is sequentially shifted by sending a command to the detection areasetting unit 1103 (step S1504). At each of the shifted position, imagesensing is performed by focusing on an object in the detection area 1402(step S1505). From the sensed image, an image of the effective area 1403is stored in the RAM 1107.

[0131] Each time a focused image is obtained from the effective area1403, it is determined whether or not focused images for the entiredisplayed image 1401 are obtained (step S1506). If there is still afocused image whose effective area 1403 has not been stored in the RAM1107, the detection area 1402 is shifted such that the effective area1403 to be obtained next is included in the center of the detection area(step S1504), then AF control is performed, and the image of theeffective area 1403 at that position is obtained and stored (stepS1505). In the fourth embodiment, the effective area 1403 is obtained inthe sequence such that the detection area 1402 is shifted by a verysmall amount in the order of raster scanning, starting from the topleft, and each time the detection area is shifted, the focused image inthe effective area 1403 is acquired. Note that the order of shifting thedetection area 1402 in the displayed image 1401 is not limited to thisexample.

[0132] If it is determined in step S1506 that focused images for all theeffective areas 1403 are obtained, the focused images of the effectiveareas 1403 stored respectively in the RAM 1107 are synthesized (stepS1507). All the focused images are synthesized (FIG. 17B) by using thefocused image obtained from the detection area 1402 for the periphery ofthe image (range defined by equations (7) and (8)) and by using thesynthesized image of a plurality of focused images of effective areasfor the central portion of the image (range defined by equations (5) and(6)). The image on which image synthesizing processing has beenperformed is outputted to the monitor 1115 (step S1508).

[0133] By the method described above, an image is collected in unit ofthe small area, i.e., effective area 1403, based on the focal pointdetection area 1402, and these images are synthesized to generate anentirely focused image and the generated image is displayed. Accordinglyin the outputted image, differences in optical parameters are reduced inthe neighborhood of the boundary where neighboring effective areas orthe like are combined. As a result, image quality is improved.

FIFTH EMBODIMENT

[0134] The fifth embodiment of the present invention provides an imagesensing system capable of controlling directional parameters such aspan/tilt, in addition to having the construction of the image sensingsystem according to the fourth embodiment.

[0135]FIG. 19 is a block diagram showing a construction of an imagesensing system according to the fifth embodiment. Referring to FIG. 19,besides the fact that a direction controller 1118 is provided in thecamera apparatus 1101 for controlling the image sensing direction of acamera apparatus by the CPU 1106 through RS-232C or the like, otherconstructions are identical to that shown in FIG. 14. Thus, descriptionthereof is not provided herein. In the fifth embodiment, the imagesensing direction is controlled by panning (rotate on a vertical axis)or tilting (rotate on a horizontal axis).

[0136] The principle of the fifth embodiment is shown in FIGS. 20A to20C.

[0137]FIG. 20A is an omnidirectional model. More specifically, a surfaceof the cube shown in FIG. 20A represents an image picked up when thecamera posture is controlled to face the corresponding direction (thedirection extended from the center point P to the center of the planesurface). Each surface of the cube shown in FIG. 20A is constructed byan entirely focused image shown in FIG. 20B. An image 1702 is obtainedby synthesizing a plurality of image areas 1703 as described in thefourth embodiment. Although a regular hexahedron model (cube) is usedherein, other closed polyhedra, e.g., a regular tetrahedron or regularoctahedron, may be used.

[0138] Once such omnidirectional image is sensed and stored in the RAM1107, an image in an arbitrary image-sensing direction can be reproducedby using the image stored in the RAM 1107, without actually changing thedirection of the image sensing system. To reproduce an image in anarbitrary direction, the method that an image of the polyhedron isprojected from the center of the omnidirectional image model to an outerplane surface of the model can be applied.

[0139] To sense an entire-focused omnidirectional image, first, a cameraapparatus is placed at the center point P, then an entirely focusedimage is sensed at four positions by panning a camera apparatus by 908,and at one of the four positions, the camera is tilted by 908 to sensean entirely focused image. The entirely focused image is obtained byperforming posture control of a camera apparatus such that the opticalaxis of the camera is directed to the center of each surface of themodel and executing the method described in the fourth embodiment. Inthe fifth embodiment, it is assumed that the bottom portion is notsensed, and panning and tilting control has a precision equivalent toone pixel or less.

[0140]FIG. 20B shows the entire image 1702 synthesized by the processingof the image sensing system according to the fourth embodiment, and agroup of effective areas 1703 (very small area in a focal pointdetection area as described in the fourth embodiment). In FIG. 20B, thelength of the image and the length of the group of effective areas arerespectively indicated as I_(x) and E_(x).

[0141]FIG. 20C is a top plane view of the omnidirectional image modelshown in FIG. 20A, cut horizontally through the center point P. Herein,description will be provided on four surface images laterallysurrounding the center point P. The same image processing can be appliedto the four surface images vertically surrounding the center point P.

[0142] By projecting the image on the image model 1704 to the planesurface 1707 from the center point 1705 (center point P) of the imagemodel to the outward direction P-D 1706, it is possible to display animage as if the image of the plane surface 1707 is displayed withoutactually directing the image sensing system to the direction P-D 1706.

[0143] As a condition for sensing an omnidirectional image andsynthesizing images in the above-described manner, the image sensingsystem 1102 must have a wide field of view. Considering an angle ofviewing the group of effective areas from the center of a regularhexahedron, i.e., a viewpoint, a sufficient angle of view (field of viewangle) is necessary to generate an omnidirectional image shown in FIG.20C.

[0144] In general, it is difficult to obtain an image having 90° angleof view with very little distortion. However, there is a known techniquewhere lens distortion is corrected by image processing. Furthermore, byincreasing the number of surfaces of the polyhedron as theomnidirectional image model, the angle of view of each surface isreduced. Thus, by using a lens having little distortion in theomnidirectional image model having a small angle of view, the process ofcorrecting distortion of images can be omitted. Upon obtaining asynthesized image of each plane which is processed as described above,the synthesized images are further combined to generate anentire-focused omnidirectional image.

[0145]FIG. 21 is a flowchart showing the processing related to the imagesensing system according to the fifth embodiment. Upon starting aprogram (step S1801), an omnidirectional image model is set (stepS1802), the size of focal point detection area is set (step S1803), andthe size of effective area is set (step S1804). The processings in stepsS1803 and S1804 are the same as that of steps S1502 and S1503 in FIG.18.

[0146] Next, with respect to a plane surface of the omnidirectionalimage model, posture control of a camera apparatus is performed suchthat the camera apparatus is directed to the center of the plane surface(step S1805). Then, processings in steps S1806 to S1808 are performed.Since steps S1806 to S1808 correspond to steps S1504 to S1506 in FIG. 18and the processings performed are the same, detailed description thereofwill not be provided herein.

[0147] Upon sensing an image of a plane surface and storing the focusedeffective areas of the entire image in the RAM 1107, the cameraapparatus is directed to another plane surface for forming anomnidirectional image model. Then, image sensing is performed and afocused effective area is stored in the RAM 1107 (step S1809) accordingto the above-described processing.

[0148] Then, the processing proceeds to step S1810 where anentire-focused omnidirectional image is generated by utilizing the groupof effective areas for all five plane surfaces, which are stored in theRAM 1107. The synthesized image may be displayed as a panorama image bylaying out the images of the lateral four plane surfaces (cutting oneedge and unfolding the cube); alternatively, a part of the images may bedisplayed. The generated image is outputted to the monitor 1115 (stepS1811) and the processing ends (step S1812).

[0149] In the above description of the third to fifth embodiments, theparticular attention is given to focusing as a camera parameter, anddescription is provided on the method of obtaining a focused image inall portions of the image by utilizing the AF function of the cameraapparatus. However, the present invention is not limited to theseembodiments. With respect to other camera parameters, by automaticallyadjusting a detection area with respect to a part or combination ofplural parameters, it is possible to obtain a synthesized image wherecamera parameters in each of the detection areas are optimized.

[0150] According to the above description of the third to fifthembodiments, even in a case of sensing a scene including a largelyvarying depth, it is possible to obtain an image where all portions ofthe image is focused.

OTHER EMBODIMENTS

[0151] The present invention can be applied to a system constituted by aplurality of devices (e.g., host computer, interface unit, camera,printer) or to an apparatus comprising a single device (e.g., variouscameras).

[0152] Further, the object of the present invention can be also achievedby providing a storage medium storing program codes for performing theaforesaid processes to a system or an apparatus, reading the programcodes with a computer (e.g., CPU, MPU) of the system or apparatus fromthe storage medium, then executing the program.

[0153] In this case, the program codes read from the storage mediumrealize the new functions according to the invention, and the storagemedium storing the program codes constitutes the invention.

[0154] Further, the storage medium, such as a floppy disk, hard disk, anoptical disk, a magneto-optical disk, CD-ROM, CD-R, a magnetic tape, anon-volatile type memory card, and ROM can be used for providing theprogram codes.

[0155] Furthermore, besides aforesaid functions according to the aboveembodiments are realized by executing the program codes which are readby a computer, the present invention includes a case where an OS(Operating System) or the like working on the computer performs a partor entire processes in accordance with designations of the program codesand realizes functions according to the above embodiments.

[0156] Furthermore, the present invention also includes a case where,after the program codes read from the storage medium are written in afunction expansion card which is inserted into the computer or in amemory provided in a function expansion unit which is connected to thecomputer, a CPU or the like contained in the function expansion card orunit performs a part or entire process in accordance with designationsof the program codes and realizes functions of the above embodiments.

[0157] In a case where the present invention is applied to the aforesaidstorage medium, the storage medium stores program codes corresponding tothe flowcharts described in the foregoing embodiments. Briefly, thestorage medium stores modules which is indispensable to the imagesensing system of the present invention.

[0158] The present invention is not limited to the above embodiments andvarious changes and modifications can be made within the spirit andscope of the present invention. Therefore, to appraise the public of thescope of the present invention, the following claims are made.

What is claimed is:
 1. An image sensing system where a camera apparatusand a client device are connected for controlling the camera apparatusby the client device, comprising: image sensing means for sensing anobject and obtaining an image signal thereof; detection area controlmeans for controlling a detection area in the image signal; adjustingmeans for adjusting a camera parameter based on an image signal of thedetection area; storage means for storing a shape and size of thedetection area; display means for superimposing the detection area on animage obtained by said image sensing means after said adjusting meansadjusts the camera parameter, based on the position, shape and size ofthe detection area; and shift instructing means for instructing saiddetection area control means to shift the detection area.
 2. The imagesensing system according to claim 1, wherein the camera apparatuscomprises said image sensing means, said detection area control meansand said adjusting means; and the client device comprises said shiftinstructing means, said storage means and said display means.
 3. Theimage sensing system according to claim 1, wherein said adjusting meansincludes focal point adjusting means for automatically adjusting a focalpoint based on the image signal of the detection area.
 4. The imagesensing system according to claim 3, wherein said adjusting meansfurther comprises exposure adjusting means for automatically adjustingan exposure based on the image signal of the detection area.
 5. Theimage sensing system according to claim 2, wherein said shiftinstructing means outputs data related to an amount of shift of thedetection area to the camera apparatus.
 6. The image sensing systemaccording to claim 5, wherein said shift instructing means instructs toshift the detection area displayed on said display means.
 7. The imagesensing system according to claim 2, said camera apparatus furthercomprising: position data output means for outputting position data ofthe detection area to said client device; and image signal output meansfor outputting an image signal sensed by said image sensing means tosaid client device.
 8. The image sensing system according to claim 7,wherein said camera apparatus further comprises parameter output meansfor outputting current camera parameter data to said client device. 9.The image sensing system according to claim 8, wherein said displaymeans displays the camera parameter data outputted by said parameteroutput means.
 10. The image sensing system according to claim 8, whereinthe parameter data includes at least one of focused position, shutterspeed, a value of aperture stop, gain and zoom ratio.
 11. The imagesensing system according to claim 1, wherein said storage meansrespectively stores shapes and sizes of detection areas corresponding todifferent specifications of the camera apparatus.
 12. The image sensingsystem according to claim 11, wherein said display means displays thedetection area in accordance with a specification of the cameraapparatus by referring to said storage means.
 13. The image sensingsystem according to claim 1, wherein said camera apparatus is anelectronic overhead projector (OHP) which senses an object placed on aplaten.
 14. The image sensing system according to claim 13, wherein theobject is three-dimensional.
 15. An image sensing system where a cameraapparatus and a client device are connected for controlling the cameraapparatus by the client device, comprising: image sensing means forsensing an object and obtaining an image signal of the object; detectingmeans for detecting an image signal of a detection area in the obtainedimage signal; adjusting means for adjusting a camera parameter based onthe image signal of the detection area; storage means for storing theimage signal of the detection area sensed by said image sensing meansafter said adjusting means adjusts the camera parameter; shifting meansfor shifting the detection area; and image synthesizing means forsynthesizing image signals of a plurality of detection areas stored insaid storage means.
 16. The image sensing system according to claim 15,wherein said adjusting means automatically adjusts a focal point basedon the image signal of the detection area.
 17. The image sensing systemaccording to claim 15, further comprising display means for displayingan image synthesized by said image synthesizing means.
 18. The imagesensing system according to claim 15, wherein in a case where all imagesof the object sensed by said image sensing means are stored in saidstorage means, said image synthesizing means synthesizes the images ofall detection areas stored in said storage means.
 19. The image sensingsystem according to claim 15, wherein said storage means stores onlyimage signals of an effective area in the detection area, and said imagesynthesizing means synthesizes images of a plurality of the effectiveareas stored in said storage means.
 20. The image sensing systemaccording to claim 19, wherein the effective area is a central area ofthe detection area.
 21. The image sensing system according to claim 19,wherein said shifting means shifts the detection area such that theeffective areas are not overlapped.
 22. The image sensing systemaccording to claim 15, further comprising direction control means forcontrolling an image sensing direction of said image sensing means,wherein said synthesizing means synthesizes images in unit of the imagesensing direction controlled by said direction control means.
 23. Theimage sensing system according to claim 22, wherein said directioncontrol means pans the image sensing direction by 90°.
 24. The imagesensing system according to claim 22, wherein said direction controlmeans tilts the image sensing direction by 90°.
 25. The image sensingsystem according to claim 22, wherein said direction control meanscontrols the image sensing direction such that the image sensingdirection is panned in four directions and tilted in one direction. 26.A control method of an image sensing system where a camera apparatus anda client device are connected for controlling the camera apparatus bythe client device, comprising: a first image sensing step of sensing anobject by image sensing means and obtaining an image signal of theobject; a detection area control step of controlling a detection area inthe image signal; an adjusting step of adjusting a camera parameterbased on an image signal of the detection area; a second image sensingstep of sensing the object by the image sensing means after the cameraparameter is adjusted in said adjusting step; a display step ofsuperimposing the detection area on an image sensed in said second imagesensing step, based on a position, shape and size of the detection areastored in storage means in advance; and a shift instructing step ofinstructing to shift the detection area.
 27. A control method of animage sensing system where a camera apparatus and a client device areconnected for controlling the camera apparatus by the client device,comprising: a first image sensing step of sensing an object by imagesensing means and obtaining an image signal of the object; a detectingstep of detecting an image signal of a detection area in the obtainedimage signal; an adjusting step of adjusting a camera parameter based onthe image signal of the detection area; a second image sensing step ofsensing the object by the image sensing means after the camera parameteris adjusted in said adjusting step; a storing step of storing, instorage means, the image signal of the detection area sensed in saidimage sensing step; a shifting step of shifting the detection area; andan image synthesizing step of synthesizing images of a plurality ofdetection areas stored in said storage means.
 28. A recording mediumincluding program codes for processing performed by a client device ofan image sensing system where a camera apparatus and a client device areconnected for controlling the camera apparatus by the client device,said program codes comprising: codes for an input step of inputting datafor a detection area, which is referred to when a camera parameter isadjusted, in an image signal obtained by sensing an object by imagesensing means of the camera apparatus; codes for a display step ofsuperimposing the detection area on an image sensed by the image sensingmeans, based on a position, shape and size of the detection area storedin storage means in advance; and codes for a shift instructing step ofinstructing the camera apparatus to shift the detection area.
 29. Arecording medium including program codes for processing performed by aclient device of an image sensing system where a camera apparatus and aclient device are connected for controlling the camera apparatus by theclient device, said program codes comprising: codes for a detecting stepof detecting an image signal of a detection area, which is referred towhen a camera parameter is adjusted, in an image signal obtained bysensing an object by image sensing means of the camera apparatus; codesfor a storing step of storing, in storage means, the image signal of thedetection area; codes for a shifting step of shifting the detectionarea; and codes for an image synthesizing step of synthesizing images ofa plurality of detection areas stored in said storage means.
 30. Acamera control apparatus for controlling a camera apparatus having:image sensing means; detection area control means for controlling adetection area in an image signal outputted by the image sensing means;and adjusting means for adjusting a camera parameter based on an imagesignal of the detection area, said camera control apparatus comprising:display means for displaying an image sensed by the camera apparatus;obtaining means for obtaining a shape and size of the detection areafrom the camera apparatus; detection area display means forsuperimposing the detection area on the image displayed by said displaymeans, based on the shape and size of the detection area obtained bysaid obtaining means; and shift instructing means for instructing saiddetection area control means to shift the detection area.
 31. A cameracontrol method of controlling a camera apparatus having: image sensingmeans; detection area control means for controlling a detection area inan image signal outputted by the image sensing means; and adjustingmeans for adjusting a camera parameter based on an image signal of thedetection area, said camera control method comprising: an image displaystep of displaying an image, sensed by the camera apparatus, on displaymeans included in a camera control apparatus; an obtaining step ofobtaining a shape and size of the detection area from the cameraapparatus; a detection area display step of superimposing the detectionarea on the image displayed on the display means, based on the shape andsize of the detection area obtained in said obtaining step; and a shiftinstructing step of instructing to shift the detection area.
 32. Arecording medium including program codes to be performed by a cameracontrol apparatus for controlling a camera apparatus having imagesensing means, detection area control means for controlling a detectionarea in an image signal outputted by the image sensing means andadjusting means for adjusting a camera parameter based on an imagesignal of the detection area, said program codes comprising: codes foran image display step of displaying an image, sensed by the cameraapparatus, on display means included in the camera control apparatus;codes for an obtaining step of obtaining a shape and size of thedetection area from the camera apparatus; codes for a detection areadisplay step of superimposing the detection area on the image displayedon the display means, based on the shape and size of the detection areaobtained in said obtaining step; and codes for a shift instructing stepof instructing to shift the detection area.